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Abstract 



We present an update of the search for the lepton family number violating 
decay r fi'j using a complete CLEO II data sample of 12.6 million r"'"T~ 
pairs. No evidence of a signal has been found and the corresponding upper 
limit is B{t — > fi^) < 1.0 x 10~^ at 90% CL, significantly smaller than previous 
limits. All quoted results are preliminary. 
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This note summarizes results of the final search of the complete CLEO II data sample 
for the lepton number violating decay r fi'y. Although there are many possible r decay 
channels which do not conserve the leptonic quantum number, the decay r — > /i7 is favored 
by most theoretical extensions of the Standard Model |jl|]. The most optimistic predictions 
for rates of such decays are based on the supersymmetric models [QJ^ and on the left-right 
supersymmetric models . In a recent calculation ^ , based on the Minimal Supersymmetric 
Standard Model with right-handed neutrinos, a value of 2 x 10~^ for the branching fraction 
for the decay r — > /i7 has been obtained for some ranges of model parameters. In general, 
the expectations for all other lepton number or lepton fiavor violating decays of the r are 
at least an order of magnitude lower. Experimental searches for the r — > /i7 decay are 
limited by statistics, i.e., the number of observed r decays. The smallest upper limit of 
B{t yU7) < 3.0 X 10~^ at 90% CL has been published by the CLEO Collaboration using 
4.24 million r+r^ pairs. 

In this analysis we use a data sample from the reaction e^e~ t^t^ collected at CESR 
at or near the energy of the T(4S'). The data correspond to a total integrated luminosity 
of 13.8 fb~^ and contain about 12.6 million r+r^ pairs. The event selection follows the 
procedure used in the previous search 0. We study events with a 1-vs-l topology, where 
the signal candidate r decays into /i7 and the tag side includes all standard r decays into 
one charged particle, any number of photons and at least one neutrino. 

We select r+r^ pair events with exactly two good charged tracks, with total charge equal 
to zero, and with an angle between the charged tracks greater than 90°. Because radiative 
/i-pair production provides high background rates, we allow only one identified muon per 
event. In addition, each candidate event must have exactly one photon separated by more 
than 20° from the closest charged track in the lepton hemisphere. This photon must lie in the 
calorimeter barrel (i.e., | cos6'^| < 0.71, where 9^ is an angle between the photon and beam 
directions), have a photon-like lateral profile and have energy deposition in the calorimeter 
greater than 300 MeV. This minimum energy cut is dictated by the kinematics of a 2-body r 
decay. The angle between the direction of the photon and the momentum of the muon track 
must satisfy 0.4 < cos 9^^ < 0.8, where the upper limit is again dictated by kinematics, and 
the lower limit is obtained by optimizing the signal-to-background ratio. 

The main sources of background in the selected samples are due to /x-pair production, 
radiative r —>■ fi'-fui' decays, and two-photon processes. To minimize these backgrounds, 
we require that the cosine of the angle between the total missing momentum of the event 
and the momentum of the tagging particle be greater than 0.4. The missing momentum is 
calculated as the negative of the sum of momenta of the two charged tracks and all showers 
detected in the calorimeter with energies above 30 MeV. Because there must be at least one 
undetected neutrino on the tag side, the missing momentum in an event having r — /i7 
is expected to fall into the tagging track hemisphere, while for all radiative processes the 
missing momentum should be uncorrelated with the charged track on the tag side. The 
neutrino emission on the tag side should also result in a large total transverse momentum 
with respect to the beam direction. Thus, to suppress background produced by copious two- 
photon and radiative QED processes, we require that the total transverse momentum of the 
event be greater than 300 MeV/c. The selection efficiency of all the previous requirements 
is estimated as 16.2%. 

Final signal selection criteria are based on kinematic constraints since a neutrinoless r 
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decay should have a total energy and an effective mass of the /i7 consistent with the beam 
energy and r mass, respectively. To determine these final criteria, we employ two different 
techniques. First, we follow the method outlined in CLEO's previous search P for the 
decay r /i7. Then we perform a more sensitive analysis based on an unbinned extended 
maximum likelihood (EML) fit to the data. 

Following the method described in detail in Ref. 0, we parameterize the signal Monte 
Carlo mass and energy distributions separately as tailed Gaussian densities. The energy 
density is given by: 

f(E) = i {^/ + - ^)] }' exp(-r/V2) ; E < -t] ; 

1 exp(-EV2) ; E>-rj; 

E = , 

where as, rj, and I are the fit parameters. A similar formula for the mass density is obtained 
by substituting the symbol "m" instead of and "m,-" instead of "i?6eam" in the equation 
above. The signal region is then defined to be within ±3 standard deviations of the fitted 
Gaussian component of the distribution. The r mass, m,-, is taken to be 1.777 GeV/c^, and 
the beam energy E^eam varies from 5.26 to 5.29 GeV. To estimate the amount of background 
expected in the signal region, we extrapolate the data from the sideband. We assume that the 
background distributions are linear in the vicinity of rrir and Ebeam and define the sideband 
regions to be between 5 and 8 standard deviations as shown in Fig. |I[ To estimate the 
background uncertainty associated with this technique, we vary the sideband definition. 
The total expected background in the signal region is estimated as 5.5 ± 0.5 events. 

The upper limit on the r — /X7 branching fraction is estimated following the Bayesian 
prescription [^If: 

I ^"=° = 01 (2] 

a Z^n=0 n\ 

where sq is an upper limit on the number of events in the signal region at 90% CL, b is the 
expected background rate, and uq is the number of observed events. The upper limit on the 
branching fraction is then: 

B{r - /X7) < at 90% CL , (3) 

where e is the event selection efficiency and Nrr is the total number of r-pairs produced. 
Applying this technique, we obtain an upper limit on the branching fraction B{t —>■ fi'-f) of 
1.8 X 10-*^ at 90% CL. 

The systematic uncertainty in detector sensitivity 2eNT-r is conservatively estimated as 
10%. This uncertainty is obtained by adding in quadrature uncertainties in track reconstruc- 
tion efficiency (3%), photon reconstruction efficiency (5%), cut selection (5%), luminosity 
(1.4%), lepton identification (4%), Monte Carlo statistics (1.5%) and trigger efficiency (5%). 
The upper limit for the branching fraction is also affected by the uncertainty in background 
estimate: as = 0.5. To incorporate systematic uncertainty into the upper hmit, we assume 
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FIG. 1. {E^^ — Ebeam) vs (m^.y — rrir) distribution. Solid squares represent the data, open 
circles represent the signal Monte Carlo distribution. 



that the errors related to 2eA^T-T- and to the background estimate have Gaussian distributions 
and apply a technique described in Refs. @,|]. This technique reweights the probability (|) 
by a Gaussian probability density of the detector sensitivity 2eNrT and a Gaussian proba- 
bility density of the number of background events b. The incorporation of these systematic 
uncertainties increases the upper limit by 1.9% of itself. 

A more sensitive upper limit is obtained by performing an unbinned EML fit which takes 
into account the details of the distributions and correlations between the mass and energy 
of signal event candidates. The likelihood function is defined as: 

Cis,b) = ——l[isS, + bB,) , (4) 
■ i=i 

where is the number of events in the signal region and its vicinity, s and b are the numbers 
of signal and background events, respectively, and Si and Bi are the signal and background 
densities, respectively. The signal distribution is described by a two-dimensional Gaussian 
and a non-Gaussian tail in energy produced by initial and final state radiation. This tail 
covers the region below the beam energy and is modeled by a gamma-function. 
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where Aq and Aj- are the relative contributions of the Gaussian component and the non- 
Gaussian tail with the sum of Aq + At constrained to unity, am and as are mass and energy 
resolutions, respectively, p is the correlation coefficient, and a and /? define the shape of the 
non-Gaussian tail ({m,E). To obtain the parameters of the signal density Si, we fit the 
signal Monte Carlo distribution. The background is parameterized by a function linear in 
energy with the coefficients Oq and Oi obtained from a fit to the data: 



Bi{m,E) 



1 



1 



1712 - mi (ao - aiEbeam){E2 - El) + 0.5ai(E| - Ef 



[ao + ai{E - Ebeam)] , (6) 



where (mi, 7712) and {Ei,E2) are the limits defining the fit region. The region within 4 
standard deviations near the beam energy E^eam is excluded from the fit to avoid bias caused 
by the possible presence of real signal events in this region. Uncertainties of the background 
shape parameters and ai are estimated by varying the number of bins in the fit region. 

The EML fit to the data gives the number of candidates for the decay r — /i7 as 1.8 
events with an estimated statistical significance of the signal 1.0 standard deviations. The 
fit region, shown in Fig. |I], is defined to be within 10 standard deviations near the r mass 
and beam energy. The total number of events in the fit region is 53. 

To estimate the upper limit, we use a method |]TU[ developed for unbinned EML fits. Q 
For every assumed expected number of signal events s, we generate 10,000 Monte Carlo 
samples. For every sample, we generate numbers of signal and background events using 
Poisson distributions and then we generate positions of these events on the energy-vs-mass 
plane using the densities from Eqns. (^) and @. For each sample we then perform an 
unbinned EML fit to extract the number of signal events, following the same procedure as 
for the data. The confidence level corresponding to this value of s is defined as a fraction of 
samples where the extracted number of events exceeds that observed in the data, i.e., 1.8. 
We repeat this procedure until we find a value of s = sq that gives a 90% CL. This value has 
to be divided by the selection efficiency and the number of produced r-pairs in accordance 
with Eqn. (^. The obtained upper limit on the branching fraction B{t —>■ fij) is 1.0 x 10~^ 
at 90% CL. 



^ This method assumes a confidence interval to be from to sq and thus gives a different upper 
limit than that obtained by the method of Ref. |11|. The prescription |11| has been developed for 
problems with integer numbers of observed signal candidate events and, in its present shape, is 
inapplicable to EML fits. 
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To incorporate systematic uncertainty into this result, we smear the background shape 
parameters oq and ai within the estimated uncertainties assuming Gaussian distributions 
and taking into account the correlation between these two parameters. We then repeat the 
procedure described in the previous paragraph, the only modification is that now we integrate 
the likelihood function over the parameter space of and Oi. Because the parameters of the 
signal density are known with better accuracy and because we do not observe a significant 
signal contribution, the result is insignificantly affected by uncertainties in the parameters 
of the signal density function. In addition to smearing the parameters, we integrate the 
quantity l/(2eiV^T-) assuming a Gaussian distribution for the detector sensitivity 2eA^T-T- with 
a relative standard deviation equal to the estimated systematic uncertainty, i.e., 10%. A 
conservatively estimated relative effect of the systematic uncertainties on the upper limit is 
below 10%. Since this computation is not yet finished, we quote a result without inclusion 
of systematic uncertainties. 

The selection efficiencies, numbers of events, and upper limits calculated for both tech- 
niques are given in Table |. This result is limited by the total integrated luminosity and 
represents a significant improvement over the previous analysis [^]. It also, for the first time, 
restricts the parameter space of some versions of the MSSM models 0. 



TABLE I. 

Selection efficiencies, numbers of events, and upper limits. 



Method 


Method of Ref. [g 


Unbinned EML fit 


MC efficiency, e 


12.7% 


15.2% 


Number of signal events 


no = 6 


s = 1.8 


Expected background rate, h 


5.5 ±0.5 




Statistical significance of the signal 




l.Ofj 


Upper limit at 90% CL, sq 


5.8 


3.8 


Upper limit for B{t fij) at 90% CL 


1.8 X 10"^ 


1.0 X IQ-^ 
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